Web Survey Bibliography
In Web surveys, rating scales measuring respondents’ attitudes and behaviors by means of a series of related statements are commonly presented in grid formats. Besides benefits from using grid questions displaying multiple items neatly arranged and easy to complete on a single screen, grid formats often evoke satisficing behavior as respondents rush through a list of serial items quickly. This, in turn, might be at the expense of processing each item carefully resulting, amongst others, in less differentiated answers compared to using grids with fewer items or single-item per screen formats. The present experiment is designed to gain a better understanding of how respondents answer to rating scale questions and how the quality of rating scale answers can be influenced by different kinds of grid formats. For that purpose, two types of drag-and-drop rating scales are developed with the aim to retain the benefits of a grid format but preventing respondents from satisficing behaviors by either 1) dragging answer options horizontally arranged in the top row to the question items in the first column, or 2) dragging question items stacked in the top row to answer options in the first column. A 3 x 5 factorial design is implemented in a randomized field experimental Web survey conducted among university applicants (n=6000) with varying number of items (6, 10, and 16) presented in drag-and-drop formats or standard grids. Rating scale formats are examined in terms of response distribution and indicators of data quality (item nonresponse, nondifferentiation, acquiescence and extremity bias). Results indicate that while all rating scale formats yield comparable substantial responses drag-and-drop rating scales encourage higher item differentiation. However, results concerning other indicators of data quality are mixed which are discussed within the scope of the cognitive question-answer process.
Conference Homepage (abstract)
Web survey bibliography (96)
- Examining Factors Impacting Online Survey Response Ratesin Educational Research: Perceptions of Graduate...; 2017; Saleh, A.; Bista, K.
- Using Mixed Methods to Research the Professional Development Needs of English Teacher Educators in PCET...; 2017; Eliahoo, R.
- Why Do Web Surveys Take Longer on Smartphones?; 2016; Couper, M. P.; J. J.Peterson, G. J.
- The impact of visual design and response formats on data quality in a web survey of MOOC students; 2016; Maloshonok, N.; Terentev, E.
- Reminder Effect and Data Usability on Web Questionnaire Survey for University Students; 2016; Oishi, T.; Mori, M.; Takata, E.
- Investigating respondent multitasking in web surveys using paradata; 2016; Sendelbah, A.; Vehovar, V.; Slavec, A.; Petrovcic, A.
- Exploring Factors in Contributing Student Progress in the Open University; 2016; Arifin, M. H.
- Mode System Effects in an Online Panel Study: Comparing a Probability-based Online Panel with two Face...; 2015; Struminskaya, B.; De Leeuw, E. D.; Kaczmirek, L.
- Response Effects of Prenotification, Prepaid Cash, Prepaid Vouchers, and Postpaid Vouchers: An Experimental...; 2015; van Veen, F.; Goeritz, A.; Sattler, S.
- Calendar Instruments in Retrospective Web Surveys; 2015; Glasner, T.; van der Vaart, W.; Dijkstra, W.
- Cognitive Testing of Survey Translations: Does Respondent Language Proficiency Matter?; 2015; Schoua-Glusberg, A.; Park, H.; Meyer, M.; Goerman, P. L.; Sha, M.
- Nannies' Knowledge, Attitude, and Management of Food Allergies of Children: An Online Survey; 2015; Greiwe, J. C., Pazheri, F., Schroer, B.
- Is Vague Valid? The Comparative Predictive Validity of Vague Quantifiers and Numeric Response Options...; 2014; Al Baghal, T.
- Improving Survey Response Rates in Online Panels Effects of Low-Cost Incentives and Cost-Free Text Appeal...; 2014; Pedersen, M. J., Nielsen, C. V.
- The New Majority: How Will Latino Youth Succeed in the Context of Low Educational Expectations and Assumptions...; 2014; Gomez, C. A., Villasenor, E., Mann, E. S., Mandic, C. G., Valladares, E. S., Mercado, V., et al.
- Testing if Healthy Perfectionism Enhances Academic Achievement in Australian Secondary School Students...; 2014; Thorpe, E., Nettelbeck, T.
- Assessing Within-Household Selection Methods in Household Mail Surveys; 2014; Olson, K., Stange, M., Smyth, J. D.
- Web-based Emergency Department Patient Satisfaction Surveys May Introduce Potential for Bias; 2014; Broadwater-Hollifield, C., Fair, J., Podolsky, S., et al.
- Undisclosed Privacy: The Effect of Privacy Rights Design on Response Rates; 2014; Haer, R., Meidert, N.
- Dropout Rates and Response Times of an Occupation Search Tree in a Web Survey; 2014; Tijdens, K. G.
- Students First Choice – the influence of mobile mode on results; 2014; Maxl, E.
- The relationships among nurses' job characteristics and attitudes toward web-based continuing learning...; 2013; Chiu, Y.-L., Tsai, C.-C., Fan Chiang, C.-Y.
- Evaluating Arts-Based Cancer Education Using an Internet Survey among Alaska Community Health Workers...; 2013; Cueva, M., Cueva, K., Dignan, M., Lanier, A., Kuhnley, R.
- Education in the Responsible Conduct of Research in Psychology: Methods and Scope; 2013; DiLorenzo, T. A., Becker-Fiegeles, J., Gibelman, M.
- Intra-individual variation of extreme response style in mixed-mode panel studies; 2013; Aichholzer, J.
- Knowledge of palliative care: An online survey; 2013; Al Qadire, M.
- Identifying the Research Information Needs of the Racing and Breeding Industries in New Zealand: Results...; 2013; Bolwell, C., Gray, Da., Reid, Ja.
- Educational use of smart phone technology: A survey of mobile phone application use by undergraduate...; 2013; Bomhold, C. R.
- Media Commons: the process and value of centralizing services; 2013; Mestre, L. S.
- Dialogistic Presence on Community College Websites in Nine Megastates; 2013; Shadinger, D.
- Adjusting for bias in a mixed-mode CAWI survey on University students ; 2013; Clerici, R., Giraldo, A.
- An imputation approach for analyzing mixed-mode surveys; 2013; Kim, J. K., Park, Se., Kim, S. Y.
- A walking exercise on a tightrope: trying to balance coverage, probabilistic sampling and the costs...; 2013; Poggio, T.
- Validity of Measuring Educational Attainment - Education and Value Orientation in the European Values...; 2013; Ortmanns, V.
- Educational attainment in cross-national surveys: instrument design, data collection, harmonisation...; 2013; Schneider, S.
- Eliminate Item Non-Response: The Effect of Forcing Respondents to Answer in Web Surveys; 2013; Leach, L. M.
- Building a History: Collecting Comprehensive Employment Data in a Web-Based, Multi-Mode Survey; 2013; Cominole, M., Bennett, C., Caves, L.
- Use of Drag-and-Drop Rating Scales in Web Surveys and Its Effect on Survey Reports and Data Quality; 2013; Kunz, T.
- The Impact on Web Survey Drop-Out Rates of Page Number Progress Indicators Used Throughout, Near the...; 2013; Walston, J. T., Cunningham, B., Medway, R.
- Utilizing the Web in a Multi-Mode Survey; 2013; Venkataraman, L.
- Speed (necessarily) doesn't kill: A new way to detect survey satisficing; 2013; Garland, P., Chen, K., Epstein, J., Suh, A.
- Using interactive feedback to enhance response quality in Web surveys. The case of open-ended questions...; 2013; Emde, M., Fuchs, M.
- Reducing Response Order Effects in Check-All-That-Apply Questions by Use of Dynamic Tooltip Instructions...; 2013; Kunz, T., Fuchs, M.
- Ethics, privacy and data security in web-based course evaluation; 2013; Salaschek, M., Meese, C., Thielsch, M.
- Medical students’ exposure to Urology in the undergraduate curriculum, a web based survey; 2012; Derbyshire, L. F., O’Flynn, K. J.
- Social research in online context: methodological reflections on web surveys from a case study; 2012; Pandolfini, V.
- What can be said about quality in the Central Population Register based on a self-completion survey...; 2012; Falnes-Dalheim, E., Pedersen, H. E.
- Boosting Web pick-up Rates by referring to Compliance Principles ; 2012; Falnes-Dalheim, E., Haraldsen, G., Sundvoll, A.
- Ebook readings jumps, print book reading declines; 2012; Rainie, L., Duggan, M.
- Prenotification, Incentives, and Survey Modality: An Experimental Test of Methods to Increase Survey...; 2012; Tepper, J. R., Jacob, B.